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1.0 iitrodwtloi 


/ k m * m m biy robots combine ths benefits of speed and accuracy with the capability of adaptation to changes in 
the work environment. However, an impediment to the use of robots is the complexity of the man-machine 
interface. * This interface can be improved by providing a means of using apr ior 1 knowledge and reasoning 
capabilities for controlling and monitoring the tasks performed by robots. 

Robots ought to be able to perform complex assembly tasks with the help of only supervisory guidance from 
him an operators. Por such supervisory guidance, it is important to express the commands in terms of the effects 
desired, rather than in terms of the motion the robot must undertake in order to achieve these effects. 

A suitable knowledge representation can facilitate the conversion of task level descriptions into explicit 
instructions to the robot. SUch a system would use symbolic relationships describing the apr lor i information 
about the robot, its environment, and the tasks specified by the operator to generate the comands for the robot. 
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However , the knowledge representation system should provide a scheme for building assembly models in an 
envlronaent that maintains the knowledge of the spatial and functional relationships among the engineering parts 
comprising an assembly. The system then prevents ths user from violating these relationships tnlees specifically 
asked to do so. Thus, the knowledge representation system has a memory for specified constraints and prevents 
actions whose side effects cause the violation of thase constraint* 

The modeling method provides an organisational structure thit maps the relationships between the components 
of an aawambly into a set of constraints. These constraints ar k simplified using a nwber of rules to determine 
the available degrees of freedom for a component. When a not relationship is to be established, the required 
motion is calculated and the feasibility of this motion Is determined by checking against the available degrees 
of freedom. 


2*0 ?*mk Level Progri 


lng 


Task level programming is an attempt to sake use 
that enables the use of apriorl knowledge to interpret 
oriented programming languages Include A OT CP ASS, ] 


structured programming together with an information base 
the commands Issued by the programmer. Examples of task- 
and LAMA. 


The processes are expressed in terms of the desired effects on the objects. Thus, a task is completed not 
when a manipulator has completed a series ot/ motions, but when the objects have reached the desired 
configuration. The knowledge representation systeja converts the task level specifications into manipulator level 
oommwids . 

AUTCPASS (1} accepts the steps of assemblies input from the user and with the help of a model of the world, 
oon verts these into a program that a Manipulator can process. However, the systme does not recognize changes in 
relationships occurring due to manipulator actions. The user is responsible for specifying physically realizable 
operations and also for informing the system/of changes in the attachment relationships. 

RAPT (£, developed at Edinburg), ha i concentrated on specifying the spatial relationships and reasoning 
about them. The relationships between objects such as "B1 against BB" and "Cl against C2", etc., are converted 
into algebraic equations. These equations can be stressed in terms of operational parameters, such as joint 
angles of the manipulator or in terms /of the degrees of freedom for the objects. The solution of these 
simultaneous non-linear equations is quirce complicated and time cons using. However, sene efforts at recognizing 
stereotypes and applying standard solutions have been successful. The maphasis here has been on representation 
of rel at ions hips i however, the geometrical representation Is at present incomplete. Hence, path planning, 
collision detection, etc., cannot be implemented using this system alone. 

LAMA (3) uses general program oflans that are expanded by details of Individual assemblies. Polyhedral 
representation for objects permits trajectory planning and collision detection. The constraints are expressed in 
terms of parameters that are vxispec/fied elements of partially filled transformation matrices. The constraints / 
are represented as oonstraint planes, which indicate the boundaries of permissible motion. Ranges of parameters Aj 
are calculated using volume interactions and constraint plane interactions. The assumption is made that //L 
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different constraints on an object are non- inter feeing. This asstsaption is not required in the system we 
propose, as the bodies always sows within the specified constraints and inconsistent constraints cannot be 
established in a constraint enforcing environment. 

LM {4} and Feature Descriptor (5) represent other examples of task level progressing. 

Fah lean (§ proposed a task planner for robot construction tasks in a blocks' world domain. The information 
contained in the object's motion was not used. The feasibility of the final state is determined from a stability 
viewpoint# but the motion from the initial to the final state la not considered. A task planner built in a 
knowledge base that considers the feasibility of object motion can be Integrated with a trajectory planning 

system. 

In the proposed knowledge representation system# a constraint enforcing environment is provided at the level 
of the database. This approach peraits supporting a task planner as well as interactive sessions with the 
programmer. This approach varies from the traditional approach by transferring some supervisory capability to 
the computer. The feasibility of motion in a constraint enforcing environment is determined by mapping 
relationships into a constraint set# simplifying the constraint# and interpreting the resulting constraints. 

3.1 G eom e trical Modal 

Homogeneous transformations are used to eipress the position and orientation information for objects. The 
position and orientation with respect to the world reference frame is stored with each object. Hence# this 
information In updated only when the object moves. The primitives# eg.# blocks and cylinders# are defined in 
terms of the centroid position and faces. Loci definitions are used as they are sufficient for the reasoning 
involved in constraint simplification as discussed later. 

An assembly is defined recursively as an object consisting of other objects. By Imposing the restriction 
that these primitives cannot move relative to one another# we can create rigid assemblies. We can represent 
mechanisms by permitting specified relative degrees of freedom for the primitives that combine to form the 
aaamably . 

4.0 Relationships 

The objects can be related to one another in a variety of ways with regard to relative aotion. These 
relationships are shown in Piqure 1. The contact relationships involve both concave and convex surfaces. A 
contact relationship between two convex surfaces is called "against*. The against relationship can involve a 
surface# edge# or a point contact between two bodies. A contact relationship between a concave and a convex 
surface is called a "fit". 


MOTION RELATIONSHIPS 





SURFACE . EDGE POINT CONTACT 


Figure li Motion Relationships 


4.1 The "Against" Relationship 

We will first define "against" in a restrictive sense and then generalize the definition. "Against" is a 
relationship established between two plane surfaces# such that translation is permitted in the common plane and 
rotation is permitted about an axis normal to this common plane. An example of against relationship is shown in 
Pigure 2. This "against” relationship exists between face PI of block Bl and face P2 of Block B2. 

This definition of "against" can then be extended to curved convex surfaces, where the contact area reduces 
from the plane to a line. The object with the curved surface retains any rotation capabilities that it had about 
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the body axis normal to tht curved cross-section, prior to establishing the "against” relationship. Similar 
definition applies for spherical surfaces where the contact reduces to a point. 


4*2 Am "Tit" Relationship 

Tit” Is a relationship established between a concave surface such as a hole and a convex surface such as a 
shaft. "Insert" is the driver function to c Demand the establisheent of a "fit” relationship. The hole and shaft 
can be of various cross-sections. The pre-condition for establishment of a "fit" relationship is that the 
profiles of the oonvex and the concave surfaces must match. 

Zn a "fit" relationship, the body containing the hole and the body containing the shaft are restrained to 
rotate about the hole-shaft axis if the profiles are circular. A translation along this axis is also permitted. 

Many special cases of "fit" can than be defined. A restricted "fit" relation ml$\t permit only rotational 
freedom. A rectangular key, on the other hand, is permitted translation but no rotation. 


Representation of other relationships such as threaded joints, etc., can be accomplished by uaing these 
basic relationships. Pcrmissable translation and rotation would no longer be Independent of each other, but 
would be related by parameters such as the thread pit<h. 


The contact relationships of "against" and "fit" and other functional relationships in the motion domain map 
into a set of motion constraints that represent the degrees of freedom for the objects. These constraints are 
represented in our aystem in terms of new primitives which are necessary for reasoning about motion. These new 
constraint relationships represent a general set into which all the relationships that pertain to motion can be 
mapped. An example of this mapping is shown in Figure 1. 



uses mcxriro rexatxon*ixr 


CONSTRAINT REPRESENTATION 


Figure 3: Mapping of Relationships to Constraints 


5.0 Drivers 

The driver functions that command the motion execution are of two types. The first type is the "move” 
faction. The "move" function is used when sane explicit motion is to be implemented by specifying the Mount of 
motion or by specifying the final destination. The second type of drive functions are those which oonaand the 
establishment of relationships. These functions determine the motion required to establish the relationship, 
find out if the motion la possible, and, if ao, then send out the necessary instructions to the robot to 
implement the motion. For the two contact relationships, "against" and "fit”, the driver functions are 
respectively called "establ is h- against" and "insert”. 

Determination of motion feasibility involves a number of steps. This is shown in Figure 4. The 
relationships of the body with other bodies, represented as constraints, are simplified to determine the 
translational and rotational degrees of freedom. If the entire desired notion is not possible with the available 
degrees of freedom, then an attempt is made to find one or more neighboring bodies such that thia set of bodies 
can together accomplish the remaining motion. This strategy is expl ai ned in Section 8. 

4.0 Representation of Motion Constraints 

We need a representation that is sufficient for the reasoning Involved in object manipulation, and is also 
simple and efficient to manipulate. We have departed from the conventional manner (Popplestone, Taylor, Mazer, 
etcj of inverting all the constraints into parametric equations and solving them over all the objects wder 
consideration . 

Let us define a few symbols first: 

T: represents a Translation degree of freedom 

R: represents a Rotation degree of freedom 

L: stands for a Line. This is used as a mnemonic for the axis of rotation or a line of translation. 

P: stands for a Plane. 
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Figure 4s Feasibility of Motion 

These mnwonlcs are combined in the following ways to give the constraints that are established by "establish- 
against” and "insert” operations: 

TPRs this code indicates that Translation is permitted in the Plane and Rotation is permitted about a 

normal to the Plane. The normal to the Plane must be specified to complete the description of the 
constraint . 

TLR« This aode indicates that Translation is permitted along a Line and Rotation is permitted about 

that Line. 

TL: This code indicates that Translation is permitted along a Line and no rotation is permitted. 

RL : This codes indicates that Rotation is permitted about the specified axis. 

The direction vector that is retired with all of these codes is called the constraint vector (CV) . Since 
the magnitude represented by this vector is insignificant, it is stored as a normalized vector. This direction 
is interpreted differently depending on the presence of P or L in the code. 

Besides the above constraint primitives, we must define a few additional constraint classes in order to 
implement a working set. These include three other constraints — "Stationary,” "Attached," and "ri«d" — and the 
unconstrained condition, "Free”. -These are clarified as follows: 

The "Stationary” constraint indicates that the object has a particular position and orientation, an<* these 
cannot change. 

Object A is said to be "Attached” to Object B when A and B always move together. In other words, A is 
rigidly connected to a Every object must store a list of all other objects that are "Attached" to it. When the 
move 001 m and la to be executed for an object, all the "Attached" objects should move together. 

As opposed to the "Stationary” and "Attached” constraints which are specified by the user, "Fixed" is a 
constraint derived from a set of user specified oonstraints. "rimed" represents the condition when a combination 
of constraints applied to an object results in no freedom of movement for the object when considered as a single 
entity. However, the implication is that the object could move if it were to move together with one of the 
constrained objects. This is clarified by the example shown in Figure 5. 

Consider the case when the following constraints are established: 

B1 AGAINST B2 ( F2 FI) 

B2 AGAINST B3 (F3 F4) 

The features involved are Indicated within parentheses. 

Under these two constraints, B2 can translate along a line in and out of the paper. Now, suppose we 
establish a third relation B2 AGAINST B4 (F5 75) in which B4 is behind B2. The result is that B2 is now "fixed" 
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Figure 5: B2 "Fixed* By Constraints 

and cannot move by itself. However, any of the combinations (B2,B4), (B2, B3), and <B2, Bl) can move along 
different directions. 

The constraints only describe the restrictions that the environment has on the object's motion. The driver 
functions, the "move" conn and , and the commands to establish relations use these constraints to determine whether 
the body can be moved or some other body needs to move along with the body prior to transmitting the ooamand to 
the robot. By using these constraints, we can build assemblies in a constraint enforcing environment where the 
user or the task planner is prevented from violating any previously specified constraints, unless the system is 
specifically asked to do so. 

In order to determine the available degrees of freedom, we will first show how to simplify the motion 
constraints in the next section. Following that, we will develop a method of determining the available Agrees 
of freedom from the specified constraints. 

7.0 Simplification of Constraints 

Seme rules for simplifying constraints are presented here. These apply to the case of rectangular blocks 
and cylinders. The extension to other bodies involving curved surfaces and to more general profiles Is posable. 

The rules may not represent a complete set, but are sufficient to demonstrate the f easibi 1 ity of the 
approach. Thie rules which follow are for a prototypical object B1 which is being commanded to move by some 
driver function si Rifles is mapped into); 

1. IF (TPR CV1) AND ( TPR CV 2) AND CV1 X CV2 i 0 
THEN (TLCV) AND CV - CVl X CVl 

Consider the motion for B1 in the following exsaples (Figure 6). 

32 A® INST B1 (F2,F1) (TPR CVl) 

B3 AGAINST 94 ( F4, F3) -*» (TPR CV2) 

Since CVl and CV2 are orthogonal to each other and lie in the plane. Bi can translate along a line in and out of 
the plane. 

2. IF (TPR CVl) AND (TPR CVl) AND CVl X CV2 - 0 
THEN (TPR CVl) CR (TPR CV2) 

Consider the motion for Bl in the following example (Figure 7a). 

92 AGAINST Bl ( F2, Fl) (TPR CVl) 

B3 AOUNST Bl (F4,F3) (TPR CV2) 
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Figure 61 B2 Agiirwt Bl (12, 11) 
B3 Against B1 <F4, P3) 



Figure 7a * B2 Against Bl (P2, Pi) 

B3 Against Bl (F4, F3) 

BL can still translate in the plane perpendicular to CVl and rotate about CV1. Using CVl or CV2 does not natter 
As shown in Figure Tb, CVl and CV2 can also be pointing in the sane direction. 
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Figure B2 Against Bl (F2, PI) 

B3 Against Bl (F4, F3) 

3. IF (TLR CVl) AND (TLR CV2) AND CVl X CNG 1 0 
THEN FIX 

Consider the motion for Bl in the following example for a "fit* relationship between a shaft and a hole (Figur* 

«) . 

B2 FITS Bl <S2, HI) -v- (TLR CVl) 

Bl FITS B3 (SI, H3) ^ (TLR CV2) 

Bl cannot move all by itself. However, Bl and H2 can move together as can Bl and B3. 

4. IF (TLR CVl) AND (TLR CV2) AND CVl X CV2 - 0 
THEN (TLR CVl) OR (TLR CV2) 

Consider the motion for Bl in the following exaaple (Figure 9), 

Bl FITS B2 (SI, K2) (TLR CVl) 

HI FITS B3 (SI, H3) (TLR CV2) 

Until now, we have been considering infinite lines and planes and, hence, no mention has been made regarding th 
depth of the hole and the length of the shaft. These parameters will be introduced later as factors necessar 
for determining the possibility of establishing relations retired for object manipil ation. 
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Figure 8 1 B2 Fits B1 (82, HI) 
BL Fits B3 (SI, H3) 



Figure 9 1 Bl Fits B2 (Si, K2) 
HI Fits B3 (SI, H3) 

5. IP (TPR CV1) AND (TLR CV2) AND CVl X CV2 • 0 
THEN (RL CVl) OR (RL CV2) 

Consider the motion for Bl In the following example (Figure 10) . 

B2 AOMNST Bl (F2,Fl) ( TPR CVl) 

Bl FITS B3 (SI, HQ -♦ (TLR CV2) 


CV2 



Figure 10: B2 Against Bl (T2 t FI) 

HI Fits B3 (SI, H3) 

Bl can rotate about CVl. B2 AGAINST Bl permits translation in e plane while BL FITS B3 permits translation along 
the normal to the same plane. The net result is that Bl cannot translate at all. 

6. IF ( TPR CVl) AND (TLR CV2) AND CVl X CV2 f 0 

THEN, IF CVl - CV2 - 0, THEN (TL CV2) , ELSE FIX 

Consider the motion for Bl in the following example (Figures 11a and lib). 
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Fiqure Ua: D1 Arjalnst I*?. { H , F2) 

m pitn in ( :;i, in > 



Fiqure 1 Hi t Ml Aqa I nst M2 (FI, F2) 

Ml Fits Ml ( M , HI) 

Ml AGAINST M2 <Fl,F2> (TVR CVl) 

ni fits M3 na, mi h»» (ti.k cv2) 

MI can translate a 1 onq CV2 an shown in Fiqure I la lor CVl 0V2 « 0. IkMnvor , an ntown in Fiqure lll>, when 
CVl CV2 / 0, Ml cannot move at ail. 

7. rP STATIONARY AND ANY ONE ttJNSTMA INT 
THEN STATIONARY 

If a body is stationary, it cannot move at all. 

8. IF FIX AND ANY 01® CONSTRAINT KXCtrT STATIONARY 
THEN FIX 

If a hody is constrained so that it cannot move by itself, then conntrni ni nq it further wit I not ohanqe the Fit 
constr ai nt . 

9. rF FREE AND ANY ONE CONSTRAINT C 
THEN C 

Free refers to an unaonstrai ned state and, hence, c is the only one constraint. 

The relationships of a tody with other todies are stored symbolical 1 y usinq the constraint, primitives 
discussed ahove. When motion feasibility is to be determined, the different re 1 at i onr; hi pn are first amplified 
usinq these rules. If a qroup of Indies moves together, then al 1 their relationships with other objects ar*- 
simplified in order to determine the feasibility of motion of the qroup as a whole. 

The simplification l r. compl eted when we have all the possible translational and rotat;sr.al deqree?; : 
freedom for the hody or set of todies. All the constraint vectors are converted into the world reference f rane 
before simplification. This approach is preferred to updating the constraint vector every time the position of 
the ohject changes, since the numher of updates required is reduced. 

The next section discusses the implementation strateqy for motion and f or the est-ibl istanent of relations. 

8.0 Strateqy for Irrpl*»ei»tinq Motion and for XstabI ishnent of ■elatiormhlpa 

Every pr i mi ti ve object has an ar hi tr ar i 1 y se 1 ected reference point. The position ol this point and t^» 
orientation of the tody a tout this point an measured in the world reference frame is cons i tor ed as the pr>s l r i r. 
of the object. The position and orientation of features are desert tod relative to this reference to 1 nt . 

bet us first consider the motion of a primitive object. When the mot i on of this tody to a par* i cu 1 >r 
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position and orientation is desired, the Motion Matrix is given by 
MOTION • ((XD-POSITION )" 1 <«W-PCBITION) 

, using the homogeneous tr ana format ion notation. This is represented by the dlaqran in Figure 12. 



OLD-P08ITION 

Figure 12: Calculation of Motion Matrix 


S.l Establishing Relations 

Driver functions such as "es tabl ish-aga i net* and "insert” are used to establish relations between objects. 
These commands are used to calculate the necessary notion matrix which is used to move the body in ocdci to 
establish a relationship. 

Consider the diagram shown in Plgure 13. Let us define the terms used in this diagram: 


P0SB1 : 
0LD-P0SB2 : 
NEW-PC6B2 : 


MOT I CM : 

FEAT1, FEATS: 
REL-ESTABLISH: 


position of object Bl in the world 
position of object B2 before moving 

position of object B2 after the relation has heen established. This in rodetermi ned at this 
stage . 

The motion regu ired of Cb ject B2 to establ ish the rel at ion. This is yet to he determ i ned. 
position of features on bodies Bl and B2 that are involved in this relation, 
a matrix that orients the constraint vectors to establish the relevant relation. 



0BJECT2 RELATION OBJECT! (FEAT2.FEAT1) 


Figure 13: Establishing Relations 

In the cas e of the "aga i ns t" re 1 at ions hi p, the REL-ESTAB LIS H mat r i x woo 1 d def i ne t he rotation needed to 
bring the normal vectors associated with the two faces in line with each other. In the case of the "fit" 
relationship, it is the matrix that brings the two axial vectors in line with each other. 

To determine REL -ESTABL IS H, consider the example in Figure 14. Consider two unit normal vectors Nl and N2, 
associated with the faces Fl and F2 of two objects Bl and (£. 


Nl 



TO MAKE Bl AGAINST B2(F1.F2) 

ROTATE B2 BY ACOStNl J42) ABOUT Nl X N2 


Figure 14: Definition of REL-ESTABLISH 

HI and N2 are two vectors to be aligned. A rotation of Nl by an angle *cos“* (HI fC) about the direction 
Hi x H2 will bring them into line with each other. This rotation is the one defined by REL -ESTABL ISH (Equation 
1). An additional translation is required to bring the two faces together. NEW~PQSB2 incorporates the combined 
rotation and translation of this new position for B2 (equation 2). MOTICN is calculated using this new position 
NEW-P0SB2 (Equation 3). 


0 
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RE L -ESTABLISH 


ROT COS' 1 { NL N2) , Ml XN2 


0 


0 

0 0 0 1 
[«W-PC6-B2] - (PC6B1) ( FEAT1) { RE L -ESTABLISH) (nEAT2)~ l 

[mCTTIOnJ - (0LD-PCB-B2)” 1 (1EW-PC6-B2) 

The following * loop equation* can be used at any tlaie to determine if the relation has been established, 
the equality is satisfied, then the relation has been established. 


U) 

( 2 ) 

(3) 

If 


^IEENTITyJ - (PC6B1) (fE ATI) (FEAT2)* 1 (PC6B2)* 1 { 4> 

The next task is then to find out if this motion is feasible in the presence of the already established 
constraints . 

However, there is one factor that still needs to be considered. The above-mentioned strateqy for 
establishing relations will work only if object Bl does not move while object B2 is being moved. If object B1 
moves in the process of achieving the required motion for object B2, then the relation is not yet established. 
This is explained by the following example (see Figure IS). 
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Figure 15: Example of Unachievable Relationship 

The given constraint is Bl ATTAOED B2 (F3 F4) . We try to establish the relation EQ AGAINST Bl (FI FI). 

The motion needed by B2 to establish this relation is calculated, and in this case, it is simply a 
translation in the x direction. When this motion is attempted, it is found to be feasible and, hence, is 
implemented. Bit since Bl and GQ are "attached", Bl will a 1 so move and, hence, the desired r el ationship wi 1 1 not 
be established. In fact, for this example, the relation can never be established since the two bodies are 
attached and, hence, move by the same amomts. 

This problen is resolved by using an iterative procedure. Consider the diagram shown for the general case 
i n Fi gore 1 6. 

In the first attempt, motion M is the required movement of object B2 to establish the relation. However, in 
the process of planning motion M, motion Ml of object Bl also occurs. At the end of motion M, the "loop 
equation" (Station 4) is used to check if the relation has been established. If the relation is established, 
the new motion matrix will indicate zero translation and rotation. If the relation is not established, then an 
iteration is performed in which NP2 is redefined as OP2, Pl* is redefined as Pi, the new rel-es tatl ish matrix is 
given by FE\ and the motion matrix is recanputed. This is shorn as M2 in Figure 16. By canparing the motion M 
with motion M2 (as shown later), one can find if any progress has been made towards establishing the relation. 
If no progress is made as in the example in Figure 15, then we conclude that the new relation cannot be 
established in the presence of the al ready establ ished relation. 

In the above iterative approach, it is necessary to determine if progress has been achieved in bringing the 
two objects closer to each other. We assume that the iteration is successful if the new motion prediction is 
"smaller" than the "initial" motion prediction. A mechanism to compare an initial motion prediction with a new 
motion prediction is described in more detail in reference (7). 
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B.2 PsMsibility of Motion 

In order to decide whether s particular body notion is feasible or not , we need tc consider the constraints 
to which the body is subjected. We have shown how to simplify these different constraints in order to determine 
the posai bl e degrees of freedom. In order to facilitate the process of determining motion feasibll ity# tbs 
translation and rotation are each handled separately. 

If, after simplification has been performed, the constraint code includes TU then a part of the translation 
needed can be accomplished by moving the body along the direction given by the constraint vector. If the 
constraint aode includes TP, then a part of the motion is achieved by translating in the specified plane. If the 
entire desired translation is not possible, then one cannot achieve the entire motion by moving this object 
alone. One must then consider moving a neighboring object along with the body of interest. This strategy is 
described later. 

The rotation part of a given motion matrix is converted into an equivalent angla about an axis locatad in 
the world reference frame. The constraint vector associated with the rotation dagraa of freadom is then compared 
with this equivalent axis. If the two coincide, then the rotation is possibles otherwise, the rotation is not 
possible by this body alone. 

If the body is foind to be constrained from moving when considered alone, then the following strategy for 
considering cooperative motion with neighboring objects is pursued. A search similar to e breadth first search 
is used. Thi s is best ejqplained by an example (see f'i^ire 17). 
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Figure 17: Cooperative Motion 

Consider an attempt to move the object Bl. aippoae the following relations alraady axist: 


in 



•1 I* in contact with 12 and SI* 

12 Is In aontsct with B4 and 15. 

9m first attempt Is to find If Bl can bs moved fay ths r«silr«d asoist all a Iona. If this Is not possible, 
than an attaint is nada to oonsldar tha notion of Bl and B2 together. in tha constraint simpl If ication that la 
par fora ad, tha constraints between tt and B ara not oonsldar ad in this ossa as 11 and B do not havw relative 
notion* 

If 11 and B cannot accomplish tha aatira remaining notion together, than B and B ara oonsldar ad together. 
If tha antlra notion is still not implemented, than 11, B2, and 11 ara oonsldarad together. Tha saarch ordar 
us ad is (11), (11,12) , (11,13), (11,12,13), (11,12,14), (11,12,15), (ll,B,13,M), (11, 12, 13, 15) , AND 
(11, 12,13, 14,15). 

Tha sat (11,12,13) is oonsldarad bafora (11,12,14) sinoa 12 and 13 ara in diract contact with 11 whidi Is 
tha objact of Intarast. Tha governing tula in this saarch is to always attsnpt to nova a nininun nun bar of 
bodies prior to attempting a larger sat. 

At each sta 9 a in tha saarch, notion Is carried out as far as possible. If there is still sons notion 
inquired, than tha saarch continues. As a result, tha total desired notion for 11 night be achieved partly ty Bl 
alone and portly fay fit and B together. 

If a constraint "Stationary" is encountered in tha search, tha search along tha path is immediately 
terninated. Note that all tha attached bodies ara always considered together in this notion feasibility 
psradi^i. 

the structure is described as a tree diagram. However, ths general istd version can be a graph (sea rigors 
IBS). This graph can bs oonverted into s tree by repeating appropriate node# (see Figure 1S>). 
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Figure IB: Conversion of Graph to s Tree 

9.3 Motion of Assemblies 

To determine the motion poss i bi 1 i ti as for an assembly, we have to treat them as an "attached" group of 
primitives. Ne store the position and orientation information for each primitive. When the assembly has to 
move, all ths primitives must move by ths same amount. 

1.4 Range of Motion 

In our discussion so far. we have considered the constraints as basically degrees of freedom. For instance, 
TPR indicates that translation is allowed in a plane and rotation is permitted about the normal to the plane. 
However, theae motions are not Infinite. These motions are limited by the finite dimensions of the bodies 
involved In the relationship. 

*9. 0 ttplmnamtation 

Ths knowledge representation system described here has been implemented using ths FLAVCK system on the LW 
LISP Machine. A typical data network is shown in Figure 19. In the constraints discussed above, we did not 
Include the range of motion. Geometric algorithms to detect col 1 ision of objects and over lapping of faces, 
overlapping of two holes, etc., are implmaented as tests to bs conducted before sending any motion command to the 
robot. This scheme provides for expandability of the system to incorporate checks such as tolerance matching, 
surface finish matching, checking types of fit, calculating inertia properties, etc. Some examples can be fowd 
in reference ( Jj . 

The system described thus far is s constraint enforcing system. The breaking or making of relationships as 
s side effect of motion is not considered. This consideration of dynamic constraint propagation requires a 
constraint network on a global scale which was indeed designed end lmplamsnted (7), but is out si da ths a CD pi of 
this paper. 
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Tht rtctmgl« indicate data 
objects. The ovals indicata 
Information slots. Ovals 
connecting two data objects 
indicata inforaatlon slots In 
both data objacts. 


Pigure 19b: Data Network for Nodal Shown in PlgurS 19S 


Not a: This is not a ooaplata natwork as soaa rapatitiva structures are not shown. 


18.0 Conclusion 
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The applications of tfels knowledge representation aystem/Jar* sanifold. The programming of robots using 
higher level constructs hides the robot specific progressing details frca the user by subaerging than into the 
doaain specific knowledge base. The constraint enforcing environment provides for an on-line debugging facility 
which operates at the conceptual task level rather than at the programs syntax level. Before sending a c owe and 
to a robot , the conn and is slaul ated in the world mode 1 , and this provides for s real tiae error pr event 1 ve 
capability, with the addition of dynamic constraint propagation, the knowledge representation syatmi becomes 
capable of simulating simple assembly operations, this providts s basis for the development of a task planner. 
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